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A program is divided into several instruction streams, and each of them is executed as 
a thread. A thread processor executed the thread. The thread generates another thread, 
but one thread is controlled to make a fork operation at most once. Each thread is 
terminated in the order of generations. A thread manager may be shared with the 
several thread processors or be distributed to the several thread processors. The 
thread manager includes a thread sequencer and a thread status table. The thread 
status table manages execution status of each thread processor and parent-child 
relation. The thread sequencer requests a thread generation and permits its 
termination in accordance with the content of the thread status table. The thread 
processor can execute a thread speculatively. 

16 Claims, 24 Drawing figures 
Exemplary Claim Number: 1 
Number of Drawing Sheets: 24 
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A technique, system, and computer program for enhancing performance of a computer 
running a multithreaded server application. A scheduling heuristic is defined for 
optimizing the number of available threads. This heuristic alleviates over- scheduling 
of worker threads by defining a technique to wait to assign an incoming request to a 
currently-executing thread (upon completion of the thread's current work), instead of 
awakening a blocked thread for the incoming request. Provision is made to ensure no 
thread waits too long. Two stages are associated with a passive socket, so that a 
connection is only bound to a worker thread when work arrives for that connection. A 
new type of socket is defined, for merging input from more than one source and making 
that merged input available for scheduling. A giveback function is defined, for 
optimizing assignment of threads to incoming requests when persistent connections are 
used. Threads that go idle are put onto an idle queue, releasing them from a worker 
thread . 
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ABSTRACT: 

One aspect of the invention is a method for load balancing in a distributed object 
system running on a network comprising a plurality of computers (42, 44) including a 
first computer (44) wherein the computers (42, 44) are operable to access a plurality 
of shared objects in a distributed object system. The method comprises instructing an 
object comprising a part of an application process (50) running on the first computer 
(44) to record at least one performance statistic in response to a message directed to 
the object. The application process (50) comprises a multi-threaded process and 
includes a statistics thread (54) . Periodically, at least one performance statistic is 
obtained using the statistics thread (54) and that performance statistic is sent to a 
local agent process (48) running on the first computer (44) . The performance 
statistics are relayed to a workload service (46) running on a second computer (42) 
connected to the network. A new distributed object is instantiated in the memory of 
one of the plurality of computers (42, 44) based upon performance statistics 
maintained by the workload service (46) . 

23 Claims, 2 Drawing figures 
Exemplary Claim Number: 1 
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